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WHAT IS CLAIMED IS : 

1 . A method for managing files in a file system, comprising: 
receiving data for a file; 

storing the data for the file in a plurality of segments; 

generating an index associated with the file indicating how the file data maps to 
the segments; 

receiving an Input/Ou^ut request with respect to an address in the file; 
using the index for the file to determine the segment including data at the 
requested address in the file; and 

accessing the determined segment including the data at the requested address. 

2. The method of claim 1 , wherein data is stored in the segments by: 
writing the received file data to one segment; and 

writing further received data for the file to subsequent segments if the last 
segment to which the received data was written has no more available space. 

3. The method of claim 1, wherein each segment has a fixed byte length, 
wherein the index provides a segment order indicating an order in which file data is 
written to the segments, and wherein the index for the file is used to determine the 
segment including data at the requested address in the file by: 

determining an offset mto the file including the data at the requested address; and 
determining an integer quotient value resulting from the offset into the file divided 

by the fixed byte length, wherein the segment including the data at the requested address 

is the segment at the integer quotient value in the segment order. 

4. The method of claim 3, fiirther comprising: 

receiving user input indicating the fixed byte length of each segment. 
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5. The method of claim 1 , further comprising: 

providing a segment size that is at least greater than a byte size of a largest section 
within the file; and 

writing each file section to one segment. 

6. The method of claim 1, further comprising: 
storing the segments in a primary storage; 

copying at least one of the segments in the primary storage onto a secondary 
storage; and 

releasing at least one of the segments copied to the secondary storage, wherein 
space used by the released segment in the primary storage is available for use. 

7. The method of claim 6, wherein as a result of releasing one or more 
segments, different segments for one file are capable of being stored in the primary 
storage and the secondary storage. 

8. The method of claim 6, wherein accessing the determined segment 
including the requested address further comprises: 

determining whether the determined segment is available in the primary storage; 

and 

copying the determined segment from the secondary storage to the primary storage 
if the determined segment is not available in the primary storage. 

9. The method of claim 6, wherein releasing the segment comprises: 
storing a partial version of the released segment including less than all data in the 

segment, wherein the segment data not in the partial version is stored in the secondary 
storage, wherein the partial version remains on the primary storage after the segment is 
released. 
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1 10. The method of claim 9, wherein the partial version of the determined 

2 segment is on the primary storage and wherein accessing the determined segment 

3 including the requested address further comprises: 

4 accessing the partial version of the determined segment on the primary storage to 

5 access the data therein; 

6 reaching the end of the partial version when accessing data therein; 

7 staging from the secondary storage to the primary storage data from the 

8 determined segment that is not in the partial version; and 

9 accessing the data from the determined segment staged from the secondary storage 
1 0 to the primary storage. 

1 11. The method of claim 9, wherein the partial version is stored only for a 

2 first segment of the segments associated with the file. 

1 12. The method of claim 6, further comprising: 

2 accessing data at the end of the segment, wherein the I/O request requires further 

3 file data after accessing the end of the segment; 

4 determining from the index a next segment including file data following the file 

5 data at the end of the segment data; and 

6 accessing the next segment in the primary storage to access the further required 

7 file data. 

1 13. The method of claim 6, further comprising: 

2 maintaining metadata for each segment that is also maintained for files in the file 

3 system; and 

4 using the metadata for segments and files to determine when to copy segments 

5 and files to the secondary storage and when to release segments and files in the primary 

6 storage. 
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1 14. The method of claim 13, wherein segments and files in the primary storage 

2 are released according to their metadata if used space in the primary storage reaches a 

3 threshold level. 

1 15. The method of claim 6, wherein the file data in all the segments for the file 

2 is capable of being larger than a storage capacity of the primary storage. 

1 1 6. The method of claim 6, further comprising: 

2 reading data from one target segment on the secondary storage; 

3 determining whether a stage attribute is specified indicating a number of segments 

4 to stage ahead; and 

5 initiating read requests to stage the number of subsequent segments following the 

6 target segment fi-om the secondary storage to the primary storage. 

1 17. The method of claim 16, further comprising: 

2 receiving user input indicating the number of segments to stage ahead. 

1 18. The method of claim 1 , wherein the segment does not have a file name and 

2 is not represented as a file in the file system. 

1 19. The method of claim 1 , wherein the index is stored in the file, wherein no 

2 user data is stored in the file and all the user data is distributed in the segments. 

1 20. A method for managing files in a primary and secondary storage, wherein 

2 the secondary storage is comprised of a plurality of drives and storage devices capable of 

3 being mounted on the drives, comprising: 

4 receiving data for a file; 

5 storing the data for the file in a plurality of segments; 
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6 generating an index associated with the file indicating how file data maps to 

7 segments; and 

8 writing each segment to one of the drives, wherein segments are written to 

9 multiple of the drives to distribute the segments across multiple storage devices. 

1 21. The method of claim 20, wherein multiple segments are written in parallel 

2 to multiple storage devices in multiple drives. 

1 22. The method of claim 20, further comprising 

2 reading segments on multiple storage devices from multiple drives to stage 

3 multiple segments in parallel into the primary storage. 

1 23 . The method of claim 20, wherein the drives comprise tape drives and 

2 wherein the storage devices comprise tape cartridges. 

1 24. A system for managing files, comprising: 

2 a computer readable medium; 

3 a storage system; 

4 means for receiving data for a file; 

5 means for storing the data for the file in a plurality of segments in the storage 

6 device; 

7 means for generating an index in the computer readable medium associated with 

8 the file indicating how the file data maps to the segments; 

9 means for receiving an Input/Output request with respect to an address in the file; 

10 means for using the index for the file to determine the segment including data at 

1 1 the requested address in the file; and 

1 2 means for accessing the determined segment including the data at the requested 

13 address. 
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25. The system of claim 24, wherein the means for storing the for the file in 
the segments performs: 

writing the received file data to one segment; and 
writing further received data for the file to subsequent segments if the last 
segment to which the received data was written has no more available space. 

26. The system of claim 24, wherein each segment has a fixed byte length, 
wherein the index provides a segment order indicating an order in which file data is 
written to the segments, and wherein means for using the index for the file to determine 
the segment including data at the requested address in the file performs: 

determining an offset into the file including the data at the requested address; and 
determining an integer quotient value resulting from the offset into the file divided 

by the fixed byte length, wherein the segment including the data at the requested address 

is the segment at the integer quotient value in the segment order. 

27. The system of claim 26, further comprising: 

means for receivuig user input indicating the fixed byte length of each segment. 

28. The system of claim 24, further comprising: 

means for providing a segment size that is at least greater than a byte size of a 
largest section within the file; and 

means for writing each file section to one segment. 

29. The system of claim 24, wherein the storage system comprises a primary 
storage, fijrther comprising: 

a secondary storage; 

means for copying at least one of the segments in the primary storage onto the 
secondary storage; and 
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means for releasing at least one of the segments copied to the secondary storage, 
wherein space used by the released segment in the primary storage is available for use. 

30. The system of claim 29, wherein as a result of releasing one or more 
segments, different segments for one file are capable of being stored in the primary 
storage and the secondary storage. 

3 1 . The system of claim 29, wherein the means for accessing the determined 
segment including the requested address further performs: 

determining whether the determined segment is available in the primary storage; 

and 

copying the determined segment from the secondary storage to the primary storage 
if the determined segment is not available in the primary storage. 

32. The system of claim 29, wherein the means for releasing the segment 
performs: 

storing a partial version of the released segment including less than all data in the 
segment, wherein the segment data not in the partial version is stored in the secondary 
storage, wherein the partial version remains on the primary storage after the segment is 
released, 

33. The system of claim 32, wherein the partial version of the determined 
segment is on the primary storage and wherein the means for accessing the determined 
segment including the requested address further performs: 

accessing the partial version of the determined segment on the primary storage to 
access the data therein; 

reaching the end of the partial version when accessing data therein; 
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staging from the secondary storage to the primary storage data from the 
determined segment that is not in the partial version; and 

accessing the data from the determined segment staged from the secondary storage 
to the primary storage. 

34. The system of claim 32, wherein the partial version is stored only for a 
first segment of the segments associated with the file. 

35. The system of claim 29, further comprising: 

means for accessing data at the end of the segment, wherein the I/O request 
requires further file data after accessing the end of the segment; 

means for determining from the index a next segment including file data 
following the file data at the end of the segment data; and 

means for accessing the next segment in the primary storage to access the further 
required file data. 

36. The system of claim 29, further comprising: 

means for maintaining metadata for each segment that is also maintained for files 
in the file system; and 

means for using the metadata for segments and files to determine when to copy 
segments and files to the secondary storage and when to release segments and files in the 
primary storage. 
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37. The system of claim 24, wherein segments and files in the primary storage 
are released according to their metadata if used space in the primary storage reaches a 
threshold level. 
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38. The system of claim 29, wherein the file data in all the segments for the 
file is capable of being larger than a storage capacity of the primary storage. 

39. The system of claim 29, fiirther comprising: 

means for reading data from one target segment on the secondary storage; 

means for determining whether a stage attribute is specified indicating a number 
of segments to stage ahead; and 

means for initiating read requests to stage the number of subsequent segments 
following the target segment from the secondary storage to the primary storage. 

40. The system of claim 39, further comprising: 

means for receiving user input indicating the number of segments to stage ahead. 

41 . The system of claim 24, wherein the segment does not have a file name 
and is not represented as a file in the file system. 

42. The system of claim 24, wherein the index is stored in the file, wherein no 
user data is stored in the file and all the user data is distributed in the segments. 

43. A system method for managing files, comprising: 
a primary storage; 

a secondary storage comprised of a plurality of drives and storage devices capable 
of being mounted on the drives; 

means for receiving data for a file; 

means for storing the data for the file in a plurality of segments on the primary 
storage; 

means for generating an index associated with the file indicating how file data 
maps to segments; and 
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means for writing each segment to one of the drives, wherein segments are written 
to multiple of the drives to distribute the segments across multiple storage devices. 

44. The system of claim 43, wherein multiple segments are written in parallel 
to multiple storage devices in multiple drives. 

45. The system of claim 43, further comprising 

means for reading segments on multiple storage devices from multiple drives to 
stage multiple segments in parallel into the primary storage. 

46. The system of claim 43, wherein the drives comprise tape drives and 
wherein the storage devices comprise tape cartridges. 

47. An article of manufacture for managing files in a file system, comprising: 
receiving data for a file; 

storing the data for the file in a plurality of segments; 

generating an index associated with the file indicating how the file data maps to 
the segments; 

receiving an Input/Output request with respect to an address in the file; 
using the index for the file to determine the segment including data at the 
requested address in the file; and 

accessing the determined segment including the data at the requested address. 

48. The article of manufacture of claim 47, wherein data is stored in the 
segments by: 

writing the received file data to one segment; and 

writing further received data for the file to subsequent segments if the last 
segment to which the received data was written has no more available space. 
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49. The article of manufacture of claim 47, wherein each segment has a fixed 
byte length, wherein the index provides a segment order indicating an order in which file 
data is written to the segments, and wherein the index for the file is used to determine the 
segment including data at the requested address in the file by: 

determining an offset into the file including the data at the requested address; and 
determining an integer quotient value resulting from the offset into the file divided 

by the fixed byte length, wherein the segment including the data at the requested address 

is the segment at the integer quotient value in the segment order. 

50. The article of manufacture of claim 49, further comprising: 
receiving user input indicating the fixed byte length of each segment. 

5 1 . The article of manufacture of claim 47, further comprising: 

providing a segment size that is at least greater than a byte size of a largest section 
within the file; and 

writing each file section to one segment. 

52. The article of manufacture of claim 47, further comprising: 
storing the segments in a primary storage; 

copying at least one of the segments in the primary storage onto a secondary 
storage; and 

releasing at least one of the segments copied to the secondary storage, wherein 
space used by the released segment in the primary storage is available for use. 
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53. The article of manufacture of claim 52, wherein as a result of releasing one 
or more segments, different segments for one file are capable of being stored in the 
primary storage and the secondary storage. 
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54. The article of manufacture of claim 52, wherein accessing the determined 
segment including the requested address further comprises: 

determining whether the determined segment is available in the primary storage; 

and 

copying the determined segment from the secondary storage to the primary storage 
if the determined segment is not available in the primary storage. 

55. The article of manufacture of claim 52, wherein releasing the segment 
comprises: 

storing a partial version of the released segment including less than all data in the 
segment, wherein the segment data not in the partial version is stored in the secondary 
storage, wherein the partial version remains on the primary storage after the segment is 
released. 

56. The article of manufacture of claim 55, wherein the partial version of the 
determined segment is on the primary storage and wherein accessing the determined 
segment including the requested address further comprises: 

accessing the partial version of the determined segment on the primary storage to 
access the data therein; 

reaching the end of the partial version when accessing data therein; 

staging from the secondary storage to the primary storage data from the 
determined segment that is not in the partial version; and 

accessing the data from the determmed segment staged from the secondary storage 

to the primary storage. 



1 57. The article of manufacture of claim 55, wherein the partial version is 

2 stored only for a first segment of the segments associated with the file. 
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1 58. The article of manufacture of claim 52, further comprising: 

2 accessing data at the end of the segment, wherein the I/O request requires further 

3 file data after accessing the end of the segment; 

4 determining from the index a next segment mcluding file data following the file 

5 data at the end of the segment data; and 

6 accessing the next segment in the primary storage to access the further required 

7 file data. 

1 59. The article of manufacture of claim 52, further comprising: 

2 maintaining metadata for each segment that is also maintained for files in the file 

3 system; and 

4 using the metadata for segments and files to determine when to copy segments 

5 and files to the secondary storage and when to release segments and files in the primary 

6 storage. 

1 60. The article of manufacture of claim 59, wherein segments and files in the 

2 primary storage are released according to their metadata if used space in the primary 

3 storage reaches a threshold level 

1 61 . The article of manufacture of claim 52, wherein the file data in all the 

2 segments for the file is capable of being larger than a storage capacity of the primary 

3 storage. 

1 62. The article of manufacture of claim 52, further comprising: 

2 reading data from one target segment on the secondary storage; 

3 determining whether a stage attribute is specified indicating a number of segments 

4 to stage ahead; and 
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initiating read requests to stage the number of subsequent segments following the 
target segment from the secondary storage to the primary storage. 

63. The article of manufacture of claim 62, further comprising; 
receiving user input indicating the number of segments to stage ahead. 

64. The article of manufacture of claim 47, wherein the segment does not have 
a file name and is not represented as a file in the file system. 

65. The article of manufacture of claim 47, wherein the index is stored in the 
file, wherein no user data is stored in the file and all the user data is distributed in the 
segments. 

66. An article of manufacture for managing files in a primary and secondary 
storage, wherein the secondary storage is comprised of a plurality of drives and storage 
devices capable of being mounted on the drives, by: 

receiving data for a file; 

storing the data for the file in a plurality of segments; 
generating an index associated with the file indicating how file data maps to 
segments; and 

writing each segment to one of the drives, wherein segments are written to 
multiple of the drives to distribute the segments across multiple storage devices. 

67. The article of manufacture of claim 66, wherein multiple segments are 
written in parallel to multiple storage devices in multiple drives. 



1 



68. 



The article of manufacture of claim 66, further comprising 
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reading segments on multiple storage devices from multiple drives to stage 
multiple segments in parallel into the primary storage. 

69. The article of manufacture of claim 66, wherein the drives comprise tape 
drives and wherein the storage devices comprise tape cartridges. 



